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The  bulk  of  the  work  carried  out  under  this  contract  was  concerned 
with  algorithms  for  solving  three  types  of  optimization  problems: 

(l)  nonlinear  programming  problems  with  both  equality  and  inequality 


constraints,  (2)  nonlinear  programming  problems  with  functional 

max 


constraints  of  the  form  ij>(x,w)<0,  as  well  as  ordinary  equality  and 
Inequality  constraints  (these  arise  in  engineering  design),  and  (3) 
const rainted  optimal  control  problems. 

The  thing  that  all  these  problems  have  in  common  is  that  algorithms 
for  their  solution,  in  "conceptual"  form,  require  an  infinite  number 
of  "elementary"  operations  per  iteration  and  hence  must  be  converted 
into  "implementable"  form  by  the  introduction  of  approximations. 
Typically,  the  approximations  are  applied  to  the  solutions  of  a 
differential  equation,  or  to  the  solution  of  a system  of  equations  and 
inequalities,  or  to  the  computation  of  the  constrained  maximum  of 
a function.  Now,  it  is  not  difficult  to  see  that  arbitrary  approximation 
schemes  mav  lead  to  implementable  algorithms  that  do  not  converge. 
Furthermore,  the  Invention  of  approximation  schemes  consistent  with 
convergence  is  by  no  means  easy.  Finally,  in  many  engineering 
applications,  even  approximate  solutions  are  quite  costly  and  hence 
computational  efficiency  of  the  resulting  implementable  algorithm 
is  a very  Important  consideration  in  the  evaluation  of  an  approximation 
scheme. 

During  the  three  years  of  this  project,  (i)  we  have  contributed 
substantially  to  the  theory  of  adaptive  approximations  as  it  applies  to 
the  construction  of  implementable  algorithms.  In  addition,  (ii)  We 
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have  made  use  of  our  theory  in  developing  several  new  implementable 
algorithms  for  the  classes  of  problems  mentioned  earlier.  We 
have  developed  techniques  for  enlarging  the  region  of  convergence  without 
loss  of  rate,  of  such  algorithms  as  Newton's  method  or  secant  methods, 
by  grafting  them  onto  slower,  but  more  robust  algorithms.  We  have  developed 
a new  theory  of  convergence  in  the  sense  of  relaxed  controls  for  optimal 
control  algorithms  and,  finally,  we  have  explored  a few  problems 
in  multicriteria  optimization. 

Major  Results 

1)  Adaptive  Approximation  Theory 

For  the  purpose  of  illustration,  consider  the  following  relatively 
simple  problem,  which  is  the  absolutely  simplest  example  of  the  type 
of  problem  occurring  in  computer  aided  design. 


min  f (x) 

xGmn 


(1) 


with 


f (x)  ■ max{+(x,<>>)  |o£0} 


(2) 


and  1 differentiable,  OCR*  compact.  To  simplify  matters 

further,  suppose  that  for  each  j^Rn  there  is  only  one  <i£Q,u(x),  such 
that  f (x)“$(x,w).  Then  f(*)  is  differentiable  and  (1)  can  be 
solved  by  Armijo's  gradient  method:  (B£(0,1),  c£(0,1)  parameters) 

k. 


xi+l"*i"B  Vf(x1,»(*1)) 


(3) 


-2- 


l 


--w 


KM 


with  n->Il  * differentiable.  This  problem  has  the  same  solutions 

as  the  unconstrained  exact  penalty  problem 

min  (f°(x)+k|f1(x)  |)  (6) 

x©Rn 

provided  the  penalty  k>0  is  sufficiently  large.  An  algorithm  for  solving 

(5)  via  (6)  must  Incorporate  a scheme  for  computing  a satisfactory 

k which  is  finite  and  it  must  be  able  to  cope  with  the  nondifferentiability 

of  |f*(x)J.  In  [7]  we  have  described  a general  scheme  for  automatically 

computing  a parameter  for  an  algorithm  which  is  to  be  Inserted  into 

the  algorithm  as  a test  with  logic.  Applications  of  this  scheme 

to  new  optimal  control  and  nonlinear  programming  algorithms  are 

reported  in  [11,12,13,14].  We  also  wish  to  draw  attention  to  the  novel  way  in 

which  the  use  of  the  penalty  functions  |f*(x)|  has  been  eliminated  in 

[11]  by  the  addition  of  inequality  constraints  and  in  [14]  by  more 

sophisticated  techniques. 

3)  Stabilization  of  Locally  Convergent  Algorithm* 

Consider  the  problem 
min  f(x) 

*eiRn  (6) 

with  f:Hn-»-lt^  three  times  continuously  differentiable.  The  simplest 
version  of  Newton's  method: 

*l+l"*i~H(Xi)-1Vf (Xf)  (7) 

2 2 

(with  H(x)-3  f(x)/3x  ) converges  only  if  xQ  is  sufficiently  close 
to  a solution.  For  the  case  H(x)>0  for  all  j^*n,  Goldstein  proposed 
the  modified  method 
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xl+l“Xi~*iH(Xi.}  (8) 

ki 

with  (6e(0,l))  satisfying  a certain  line  search  rule.  The  method 

(8)  has  a greater  region  of  convergence  than  (7),  but  it  breaks  down 
when  H(x)>0  Vx  does  not  hold.  We  have  developed  algorithms  which  use  a 
test  to  switch  between  formulas  such  as  (8)  and  another  one,  such  as,  e.g., 

xi+l'xi"Ai7f (Xi) 

in  such  a way  that  the  region  of  convergence  is  enlarged  over  (8)  and 
quadratic  rate  of  convergence  is  still  retained.  Details  can  be  found 
in  [1,2,4]. 

4)  Convergence  Theory  for  Optimal  Control 

An  optimal  control  algorithm  constructs  an  infinite  sequence 
of  controls  {u^}  which  are  measurable  functions  from  an  interval 
[ tQ, t^ ]-*-lR m.  Generally,  the  sequence  {u^}  cannot  be  shown  to  have 
limit  points  in  L™[tQ,t^]  or  in  L™[tQ,t^]  or  in  L™[to,t^]  which  are 
the  usual  spaces  for  analysis.  However,  it  is  possible  to  place  this 
sequence  in  correspondence  with  a sequence  of  relaxed  controls  {u^}  which 
aLwavs  has  limit  points  in  the  topology  of  relaxed  controls.  We  have  developed 
a convergence  theory  for  optimal  control  algorithms,  which,  by  means 
of  relaxed  controls,  enables  us  to  make  meaningful  statements  about 
their  convergence.  Specifically,  although  ordinary  limits  for  the 
sequence  of  controls  do  not  exist,  the  corresponding  trajectories 
do  have  limits  and  we  show  that  these  limit  trajectories  satisfy 
certain  optimality  conditions  which  emanate  from  the  relaxed 
Pontrygin  Maximum  Principle.  The  theory  is  described  in  [9], 
applications  can  be  found* in  [14,15]. 
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So  far,  we  have  made  only  very  modest  progress  in  this  area.  Our 


results  are  described  in  [6,8].  Our  continuing  aim  is  to  construct 
computational  aids  which  facilitate  the  decision  process  on  the  Pareto- 
optimal  (i.e.  trade-off)  surface. 

Conclusion 

The  last  three  years  have  been  productive  years  for  us  during 
which  we  have  obtained  several  significant  results. 


4401$ 


; 


Published 

L.  E.  Polak,  "A  Survey  of  Secant-Methods  for  Optimization,"  Proceedings 
1973  IEEE  Conf.  on  Decision  and  Control,  San  Diego,  Dec.  1973. 

2.  E.  Polak  and  I.  Teodoru,  "Newton  Derived  Methods  for  Nonlinear  Equations 
and  Inequalities,"  Proceedings  Mathematical  Programming  (ACM) 

Symposium,  April  1974,  University  of  Wisconsin,  Madison. 

3.  H.  Mukai  and  E.  Polak,  "Approximation  Techniques  in  Gradient 
Projection  Algorithms,"  Proceedings  of  12th  Allerton  Conference 

on  Circuits  and  System  Theory,  October  2-4,  1974,  Allerton,  Illinois. 

4.  E.  Polak,  "On  the  Convergence  and  Discretization  of  Optimal  Control 
Algorithms,"  Proceedings  of  the  Conference  on  Energy  Related 
Modeling  and  Data  Base  Management  at  the  Brooklyn  National 
Laboratory  in  Upton,  Long  Island,  New  York,  1975. 

5.  H.  Mukai  and  E.  Polak,  "On  the  Implementation  of  Reduced  Gradient 
Methods,"  Proceedings  of  the  International  Federation  on  Automatic 
Control,  April  1975,  Nice,  France. 

6.  E.  Polak,  "On  the  Approximation  of  Solutions  on  Multiple  Criteria 
Decision  Making  Problems,"  Proceedings  of  TIMS  XXII  International 
Conference,  session  on  multiple  criteria  decision  making,  25  July  1975, 
Kyoto,  Japan. 

7.  E.  Polak,  "On  the  Global  Stabilization  of  Locally  Convergent 
Algorithms  for  Optimization  and  Root  Finding,"  Proceedings  of  the 
Sixth  I FAC  World  Congress  on  Computational  Methods  on  Control, 

August  1973,  Boston,  Mass.  Also,  Automatics,  Vol.  12,  No.  4,  July  1976. 

-7- 


4 


Published 

8.  E.  Polak  and  A.  Payne,  "On  Multicriteria  Optimization,"  Proceedings 
of  the  Post  I FAC  Seminar  on  Directions  in  Decentralized  Control, 
Many-person  Optimization  and  Large  Scale  Systems,  Sept.  1-3,  1975, 
Cambridge,  Mass. 

9.  L.  J.  Williamson  and  E.  Polak,  "Relaxed  Controls  and  the  Convergence 
of  Optimal  Control  Algorithms,"  SIAM  J.  on  Control  and  Optimization, 
Vol.  14,  No.  4,  1976,  pp.  737-757. 

10.  E.  Polak  and  D.  Q.  Mayne,  "An  Algorithm  for  Optimization  Problems 
with  Functional  Inequality  Constraints,"  IEEE  Automatic  Control, 

Vol.  AC-21,  No.  2,  1976,  pp.  184-193. 

In  Press 

11.  D.  Q.  Mayne  and  E.  Polak,  "Feasible  Direction  Algorithms  for 
Optimization  Problems  with  Equality  and  Inequality  Constraints," 
Mathematical  Programming,  in  Press. 

12.  H.  Mukai  and  E.  Polak,  "A  Second  Order  Method  for  the  General 
Nonlinear  Programming  Problem,"  JOTA,  in  Press. 

13.  H.  Mukai  and  E.  Polak,  "A  Second  Order  Method  for  Unconstrained 
Optimization,"  JOTA,  in  Press. 

Submitted 

14.  E.  Polak  and  D.  Q.  Mayne,  "An  Exact  Penalty  Function  Algorithm 
for  Optimal  Control  Problems  with  Control  and  Terminal  Equality 
Constraints,"  submitted  to  the  Journal  of  Optimization  Theory  and 


Applications. 

I i 


jL 


-8- 


I 


Submitted 

15.  E.  Polak  and  D.  Q.  Mayne,  "A  Feasible  Directions  Algorithms  for 
Optimal  Control  Problems  with  Control  and  Terminal  Inequality 
Constraints,"  submitted  to  IEEE  Transactions  on  Automatic  Control. 

In  Preparation 

16.  D.  Q.  Mayne,  E.  Polak  and  R.  Trahan,  "A  Cut  Map  Algorithm  for 
the  Tolerance  Problem,"  to  be  submitted  to  IEEE  Trans,  on  Automatic 
Control. 

17.  E.  Polak,  D.  Q.  Mayne  and  R.  Trahan,  "A  General  Purpose  Cut  Map 
Algorithms  for  Computer  Aided  Design,"  to  be  submitted  to  JOTA. 


-9- 


